Design of Experiments with Bayesian Optimization

Background on DoE!

Trial Function

As a trial function, let’s try to find the highest value of the function

\[\begin{align*} y=x^2\sin(5\pi x)^6 + \epsilon \end{align*}\]

where \(\epsilon\) is random noise with a scale of 0.1. We’ll limit ourselves to the region \(x\in[0,1]\).

Let’s define and plot the objective function first!

import numpy as np


def objective(x, noise=0.05):
    noise = np.random.normal(loc=0, scale=noise, size=x.shape)
    return (x**2 * np.sin(5 * np.pi * x) ** 6.0) + noise


import plotly.express as px

x_eval = np.linspace(0, 1, 100)
fig = px.scatter(x=x_eval, y=objective(x_eval))
x_eval = np.linspace(0, 1, 1000)
fig.add_scatter(x=x_eval, y=objective(x_eval, noise=0))

There are five local maxima in this range. The noise is significant here. The best maxima is the one to the right. We got this by doing 100 function evaluations.

Base case: random sampling

The easiest thing we can do is randomly pick points in the range. For a given number of random samples, we can evaluate all of them and see what the best is!

import pandas as pd

# Make an empty dataframe!
df = pd.DataFrame()

num_samples = list(range(1, 200))

for n in num_samples:

    # Run 10 trials with n samples!
    y = [np.max(objective(np.random.uniform(0, 1, size=(n,)))) for i in range(10)]

    # Add the results to the dataframe
    df = pd.concat(
        (
            df,
            pd.DataFrame(
                {"num_samples": [n], "objective": [np.mean(y)], "stdev": [np.std(y)]}
            ),
        ),
        ignore_index=True,
    )

# Plot with error bars!
px.scatter(df, x="num_samples", y="objective", error_y="stdev")

Note that our process - pick the best value of the random points is actually not giving us quite the right answer when we evaluate many times, since we also have a bit of noise in the measurements!

We can see that to get close to the real value of ~0.80 we need ~50 function evaluations.

Bayesian Optimization with ax

Bayesian optimization is one approach in a field of methods called “sequential model based optimization”. The general idea is

1. Generate a few (~2-3 times the number of variables?) random configurations in your range of interest and evaluate them

2. Fit the best Gaussian Process you can to your data

3. Ask the GP which new value is most likely to improve on the current best known point (expected improvement)

4. Sample that point and add it to the dataset

5. Go back to 2.

This is one of many, many, many possible strategies you can use!

ax is one framework for handling this loop using various types of Gaussian Process models.

See also

https://ax.dev/docs/bayesopt.html

https://ax.dev/tutorials/

from ax.plot.trace import optimization_trace_single_method
from ax.service.managed_loop import optimize
from ax.utils.notebook.plotting import init_notebook_plotting, render

init_notebook_plotting()

[INFO 10-07 20:11:06] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.

from ax.service.ax_client import AxClient


def objective_ax(parameters):
    x = parameters["x"]
    noise = np.random.normal(loc=0, scale=0.05)
    SEM = 0.05 / 2  # Assume that the value is +/- 0.05
    return {"y": ((x**2 * np.sin(5 * np.pi * x) ** 6.0) + noise, SEM)}


ax_client = AxClient()

ax_client.create_experiment(
    name="toy example",
    parameters=[
        {
            "name": "x",
            "type": "range",
            "bounds": [0.0, 1.0],
        },
    ],
    objective_name="y",
    minimize=False,
)

for i in range(50):
    parameters, trial_index = ax_client.get_next_trial()
    # Local evaluation here can be replaced with deployment to external system.
    ax_client.complete_trial(trial_index=trial_index, raw_data=objective_ax(parameters))

[INFO 10-07 20:11:06] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.

[INFO 10-07 20:11:06] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.

[INFO 10-07 20:11:06] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).

[INFO 10-07 20:11:06] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.

[INFO 10-07 20:11:06] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to  model-fitting.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 0 with parameters {'x': 0.212377}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 0 with data: {'y': (-0.046208, 0.025)}.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 1 with parameters {'x': 0.343602}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 1 with data: {'y': (0.040464, 0.025)}.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 2 with parameters {'x': 0.987842}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 2 with data: {'y': (0.000943, 0.025)}.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 3 with parameters {'x': 0.251469}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 3 with data: {'y': (-0.070405, 0.025)}.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 4 with parameters {'x': 0.72044}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 4 with data: {'y': (0.373109, 0.025)}.

[INFO 10-07 20:11:06] ax.service.ax_client: Generated new trial 5 with parameters {'x': 0.620594}.

[INFO 10-07 20:11:06] ax.service.ax_client: Completed trial 5 with data: {'y': (0.102733, 0.025)}.

[INFO 10-07 20:11:07] ax.service.ax_client: Generated new trial 6 with parameters {'x': 0.776371}.

[INFO 10-07 20:11:07] ax.service.ax_client: Completed trial 6 with data: {'y': (-0.087215, 0.025)}.

[INFO 10-07 20:11:07] ax.service.ax_client: Generated new trial 7 with parameters {'x': 0.697823}.

[INFO 10-07 20:11:07] ax.service.ax_client: Completed trial 7 with data: {'y': (0.586727, 0.025)}.

[INFO 10-07 20:11:08] ax.service.ax_client: Generated new trial 8 with parameters {'x': 0.683794}.

[INFO 10-07 20:11:08] ax.service.ax_client: Completed trial 8 with data: {'y': (0.392845, 0.025)}.

[INFO 10-07 20:11:09] ax.service.ax_client: Generated new trial 9 with parameters {'x': 0.702514}.

[INFO 10-07 20:11:09] ax.service.ax_client: Completed trial 9 with data: {'y': (0.479245, 0.025)}.

[INFO 10-07 20:11:09] ax.service.ax_client: Generated new trial 10 with parameters {'x': 0.694718}.

[INFO 10-07 20:11:09] ax.service.ax_client: Completed trial 10 with data: {'y': (0.467351, 0.025)}.

[INFO 10-07 20:11:10] ax.service.ax_client: Generated new trial 11 with parameters {'x': 0.671626}.

[INFO 10-07 20:11:10] ax.service.ax_client: Completed trial 11 with data: {'y': (0.299352, 0.025)}.

[INFO 10-07 20:11:10] ax.service.ax_client: Generated new trial 12 with parameters {'x': 0.497646}.

[INFO 10-07 20:11:10] ax.service.ax_client: Completed trial 12 with data: {'y': (0.255007, 0.025)}.

[INFO 10-07 20:11:10] ax.service.ax_client: Generated new trial 13 with parameters {'x': 0.442013}.

[INFO 10-07 20:11:10] ax.service.ax_client: Completed trial 13 with data: {'y': (0.027179, 0.025)}.

[INFO 10-07 20:11:11] ax.service.ax_client: Generated new trial 14 with parameters {'x': 0.544633}.

[INFO 10-07 20:11:11] ax.service.ax_client: Completed trial 14 with data: {'y': (0.121031, 0.025)}.

[INFO 10-07 20:11:11] ax.service.ax_client: Generated new trial 15 with parameters {'x': 0.0}.

[INFO 10-07 20:11:11] ax.service.ax_client: Completed trial 15 with data: {'y': (0.029071, 0.025)}.

[INFO 10-07 20:11:11] ax.service.ax_client: Generated new trial 16 with parameters {'x': 0.101118}.

[INFO 10-07 20:11:11] ax.service.ax_client: Completed trial 16 with data: {'y': (-0.059425, 0.025)}.

[INFO 10-07 20:11:11] ax.service.ax_client: Generated new trial 17 with parameters {'x': 0.891466}.

[INFO 10-07 20:11:11] ax.service.ax_client: Completed trial 17 with data: {'y': (0.759725, 0.025)}.

[INFO 10-07 20:11:11] ax.service.ax_client: Generated new trial 18 with parameters {'x': 0.876746}.

[INFO 10-07 20:11:11] ax.service.ax_client: Completed trial 18 with data: {'y': (0.566361, 0.025)}.

[INFO 10-07 20:11:12] ax.service.ax_client: Generated new trial 19 with parameters {'x': 0.903933}.

[INFO 10-07 20:11:12] ax.service.ax_client: Completed trial 19 with data: {'y': (0.833434, 0.025)}.

[INFO 10-07 20:11:12] ax.service.ax_client: Generated new trial 20 with parameters {'x': 0.913963}.

[INFO 10-07 20:11:12] ax.service.ax_client: Completed trial 20 with data: {'y': (0.665794, 0.025)}.

[INFO 10-07 20:11:12] ax.service.ax_client: Generated new trial 21 with parameters {'x': 0.899873}.

[INFO 10-07 20:11:12] ax.service.ax_client: Completed trial 21 with data: {'y': (0.837718, 0.025)}.

[INFO 10-07 20:11:13] ax.service.ax_client: Generated new trial 22 with parameters {'x': 0.901493}.

[INFO 10-07 20:11:13] ax.service.ax_client: Completed trial 22 with data: {'y': (0.823338, 0.025)}.

[INFO 10-07 20:11:13] ax.service.ax_client: Generated new trial 23 with parameters {'x': 0.898107}.

[INFO 10-07 20:11:13] ax.service.ax_client: Completed trial 23 with data: {'y': (0.840158, 0.025)}.

[INFO 10-07 20:11:13] ax.service.ax_client: Generated new trial 24 with parameters {'x': 0.899107}.

[INFO 10-07 20:11:13] ax.service.ax_client: Completed trial 24 with data: {'y': (0.843918, 0.025)}.

[INFO 10-07 20:11:13] ax.service.ax_client: Generated new trial 25 with parameters {'x': 0.900661}.

[INFO 10-07 20:11:13] ax.service.ax_client: Completed trial 25 with data: {'y': (0.808576, 0.025)}.

[INFO 10-07 20:11:14] ax.service.ax_client: Generated new trial 26 with parameters {'x': 0.896765}.

[INFO 10-07 20:11:14] ax.service.ax_client: Completed trial 26 with data: {'y': (0.785936, 0.025)}.

[INFO 10-07 20:11:14] ax.service.ax_client: Generated new trial 27 with parameters {'x': 0.83828}.

[INFO 10-07 20:11:14] ax.service.ax_client: Completed trial 27 with data: {'y': (0.042222, 0.025)}.

[INFO 10-07 20:11:14] ax.service.ax_client: Generated new trial 28 with parameters {'x': 0.902377}.

[INFO 10-07 20:11:14] ax.service.ax_client: Completed trial 28 with data: {'y': (0.687233, 0.025)}.

[INFO 10-07 20:11:14] ax.service.ax_client: Generated new trial 29 with parameters {'x': 0.895361}.

[INFO 10-07 20:11:15] ax.service.ax_client: Completed trial 29 with data: {'y': (0.765867, 0.025)}.

[INFO 10-07 20:11:15] ax.service.ax_client: Generated new trial 30 with parameters {'x': 0.898637}.

[INFO 10-07 20:11:15] ax.service.ax_client: Completed trial 30 with data: {'y': (0.723481, 0.025)}.

[INFO 10-07 20:11:15] ax.service.ax_client: Generated new trial 31 with parameters {'x': 0.897488}.

[INFO 10-07 20:11:15] ax.service.ax_client: Completed trial 31 with data: {'y': (0.840411, 0.025)}.

[INFO 10-07 20:11:15] ax.service.ax_client: Generated new trial 32 with parameters {'x': 0.899524}.

[INFO 10-07 20:11:15] ax.service.ax_client: Completed trial 32 with data: {'y': (0.730569, 0.025)}.

[INFO 10-07 20:11:16] ax.service.ax_client: Generated new trial 33 with parameters {'x': 0.895967}.

[INFO 10-07 20:11:16] ax.service.ax_client: Completed trial 33 with data: {'y': (0.77907, 0.025)}.

[INFO 10-07 20:11:16] ax.service.ax_client: Generated new trial 34 with parameters {'x': 0.900254}.

[INFO 10-07 20:11:16] ax.service.ax_client: Completed trial 34 with data: {'y': (0.821245, 0.025)}.

[INFO 10-07 20:11:16] ax.service.ax_client: Generated new trial 35 with parameters {'x': 0.90105}.

[INFO 10-07 20:11:16] ax.service.ax_client: Completed trial 35 with data: {'y': (0.767081, 0.025)}.

[INFO 10-07 20:11:16] ax.service.ax_client: Generated new trial 36 with parameters {'x': 0.893366}.

[INFO 10-07 20:11:16] ax.service.ax_client: Completed trial 36 with data: {'y': (0.771831, 0.025)}.

[INFO 10-07 20:11:17] ax.service.ax_client: Generated new trial 37 with parameters {'x': 0.897804}.

[INFO 10-07 20:11:17] ax.service.ax_client: Completed trial 37 with data: {'y': (0.772884, 0.025)}.

[INFO 10-07 20:11:17] ax.service.ax_client: Generated new trial 38 with parameters {'x': 0.907478}.

[INFO 10-07 20:11:17] ax.service.ax_client: Completed trial 38 with data: {'y': (0.792428, 0.025)}.

[INFO 10-07 20:11:17] ax.service.ax_client: Generated new trial 39 with parameters {'x': 0.90286}.

[INFO 10-07 20:11:17] ax.service.ax_client: Completed trial 39 with data: {'y': (0.854086, 0.025)}.

[INFO 10-07 20:11:18] ax.service.ax_client: Generated new trial 40 with parameters {'x': 0.903551}.

[INFO 10-07 20:11:18] ax.service.ax_client: Completed trial 40 with data: {'y': (0.820267, 0.025)}.

[INFO 10-07 20:11:18] ax.service.ax_client: Generated new trial 41 with parameters {'x': 0.901888}.

[INFO 10-07 20:11:18] ax.service.ax_client: Completed trial 41 with data: {'y': (0.84695, 0.025)}.

[INFO 10-07 20:11:18] ax.service.ax_client: Generated new trial 42 with parameters {'x': 0.903247}.

[INFO 10-07 20:11:18] ax.service.ax_client: Completed trial 42 with data: {'y': (0.742431, 0.025)}.

[INFO 10-07 20:11:19] ax.service.ax_client: Generated new trial 43 with parameters {'x': 0.901273}.

[INFO 10-07 20:11:19] ax.service.ax_client: Completed trial 43 with data: {'y': (0.803574, 0.025)}.

[INFO 10-07 20:11:19] ax.service.ax_client: Generated new trial 44 with parameters {'x': 0.905915}.

[INFO 10-07 20:11:19] ax.service.ax_client: Completed trial 44 with data: {'y': (0.748855, 0.025)}.

[INFO 10-07 20:11:19] ax.service.ax_client: Generated new trial 45 with parameters {'x': 0.899302}.

[INFO 10-07 20:11:19] ax.service.ax_client: Completed trial 45 with data: {'y': (0.806725, 0.025)}.

[INFO 10-07 20:11:20] ax.service.ax_client: Generated new trial 46 with parameters {'x': 0.900479}.

[INFO 10-07 20:11:20] ax.service.ax_client: Completed trial 46 with data: {'y': (0.839662, 0.025)}.

[INFO 10-07 20:11:20] ax.service.ax_client: Generated new trial 47 with parameters {'x': 0.900053}.

[INFO 10-07 20:11:20] ax.service.ax_client: Completed trial 47 with data: {'y': (0.742792, 0.025)}.

[INFO 10-07 20:11:20] ax.service.ax_client: Generated new trial 48 with parameters {'x': 0.898926}.

[INFO 10-07 20:11:20] ax.service.ax_client: Completed trial 48 with data: {'y': (0.821486, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 49 with parameters {'x': 0.156838}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 49 with data: {'y': (0.026802, 0.025)}.

from ax.plot.slice import plot_slice

model = ax_client.generation_strategy.model

render(plot_slice(model, "x", "y", density=200))

import pandas as pd

# Make an empty dataframe!
df_ax = pd.DataFrame()

y_trials = []
for i in range(3):
    ax_client = AxClient()

    ax_client.create_experiment(
        name="toy example",
        parameters=[
            {
                "name": "x",
                "type": "range",
                "bounds": [0.0, 1.0],
            },
        ],
        objective_name="y",
        minimize=False,
    )

    for i in range(100):
        parameters, trial_index = ax_client.get_next_trial()
        # Local evaluation here can be replaced with deployment to external system.
        ax_client.complete_trial(
            trial_index=trial_index, raw_data=objective_ax(parameters)
        )

    df_trials = ax_client.get_trials_data_frame()
    y_trials.append(df_trials['y'].values)

[INFO 10-07 20:11:21] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.

[INFO 10-07 20:11:21] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.

[INFO 10-07 20:11:21] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).

[INFO 10-07 20:11:21] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.

[INFO 10-07 20:11:21] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to  model-fitting.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 0 with parameters {'x': 0.53202}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 0 with data: {'y': (0.106259, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 1 with parameters {'x': 0.02183}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 1 with data: {'y': (-0.055736, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 2 with parameters {'x': 0.262813}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 2 with data: {'y': (0.026435, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 3 with parameters {'x': 0.096944}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 3 with data: {'y': (0.012671, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 4 with parameters {'x': 0.082824}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 4 with data: {'y': (0.067888, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 5 with parameters {'x': 0.693529}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 5 with data: {'y': (0.44102, 0.025)}.

[INFO 10-07 20:11:21] ax.service.ax_client: Generated new trial 6 with parameters {'x': 0.876935}.

[INFO 10-07 20:11:21] ax.service.ax_client: Completed trial 6 with data: {'y': (0.530466, 0.025)}.

[INFO 10-07 20:11:22] ax.service.ax_client: Generated new trial 7 with parameters {'x': 1.0}.

[INFO 10-07 20:11:22] ax.service.ax_client: Completed trial 7 with data: {'y': (-0.009336, 0.025)}.

[INFO 10-07 20:11:22] ax.service.ax_client: Generated new trial 8 with parameters {'x': 0.80841}.

[INFO 10-07 20:11:22] ax.service.ax_client: Completed trial 8 with data: {'y': (0.074918, 0.025)}.

[INFO 10-07 20:11:22] ax.service.ax_client: Generated new trial 9 with parameters {'x': 0.899187}.

[INFO 10-07 20:11:22] ax.service.ax_client: Completed trial 9 with data: {'y': (0.840584, 0.025)}.

[INFO 10-07 20:11:23] ax.service.ax_client: Generated new trial 10 with parameters {'x': 0.914762}.

[INFO 10-07 20:11:23] ax.service.ax_client: Completed trial 10 with data: {'y': (0.791113, 0.025)}.

[INFO 10-07 20:11:23] ax.service.ax_client: Generated new trial 11 with parameters {'x': 0.904829}.

[INFO 10-07 20:11:23] ax.service.ax_client: Completed trial 11 with data: {'y': (0.906448, 0.025)}.

[INFO 10-07 20:11:23] ax.service.ax_client: Generated new trial 12 with parameters {'x': 0.64044}.

[INFO 10-07 20:11:23] ax.service.ax_client: Completed trial 12 with data: {'y': (0.001254, 0.025)}.

[INFO 10-07 20:11:24] ax.service.ax_client: Generated new trial 13 with parameters {'x': 0.735686}.

[INFO 10-07 20:11:24] ax.service.ax_client: Completed trial 13 with data: {'y': (0.167822, 0.025)}.

[INFO 10-07 20:11:24] ax.service.ax_client: Generated new trial 14 with parameters {'x': 0.409318}.

[INFO 10-07 20:11:24] ax.service.ax_client: Completed trial 14 with data: {'y': (0.068595, 0.025)}.

[INFO 10-07 20:11:24] ax.service.ax_client: Generated new trial 15 with parameters {'x': 0.90664}.

[INFO 10-07 20:11:24] ax.service.ax_client: Completed trial 15 with data: {'y': (0.86369, 0.025)}.

[INFO 10-07 20:11:25] ax.service.ax_client: Generated new trial 16 with parameters {'x': 0.90282}.

[INFO 10-07 20:11:25] ax.service.ax_client: Completed trial 16 with data: {'y': (0.876203, 0.025)}.

[INFO 10-07 20:11:25] ax.service.ax_client: Generated new trial 17 with parameters {'x': 0.184926}.

[INFO 10-07 20:11:25] ax.service.ax_client: Completed trial 17 with data: {'y': (-0.017881, 0.025)}.

[INFO 10-07 20:11:25] ax.service.ax_client: Generated new trial 18 with parameters {'x': 0.903913}.

[INFO 10-07 20:11:25] ax.service.ax_client: Completed trial 18 with data: {'y': (0.754675, 0.025)}.

[INFO 10-07 20:11:26] ax.service.ax_client: Generated new trial 19 with parameters {'x': 0.935106}.

[INFO 10-07 20:11:26] ax.service.ax_client: Completed trial 19 with data: {'y': (0.366304, 0.025)}.

[INFO 10-07 20:11:26] ax.service.ax_client: Generated new trial 20 with parameters {'x': 0.908355}.

[INFO 10-07 20:11:26] ax.service.ax_client: Completed trial 20 with data: {'y': (0.766711, 0.025)}.

[INFO 10-07 20:11:26] ax.service.ax_client: Generated new trial 21 with parameters {'x': 0.33737}.

[INFO 10-07 20:11:26] ax.service.ax_client: Completed trial 21 with data: {'y': (0.021284, 0.025)}.

[INFO 10-07 20:11:27] ax.service.ax_client: Generated new trial 22 with parameters {'x': 0.901064}.

[INFO 10-07 20:11:27] ax.service.ax_client: Completed trial 22 with data: {'y': (0.845926, 0.025)}.

[INFO 10-07 20:11:27] ax.service.ax_client: Generated new trial 23 with parameters {'x': 0.47197}.

[INFO 10-07 20:11:27] ax.service.ax_client: Completed trial 23 with data: {'y': (0.190875, 0.025)}.

[INFO 10-07 20:11:27] ax.service.ax_client: Generated new trial 24 with parameters {'x': 0.896993}.

[INFO 10-07 20:11:27] ax.service.ax_client: Completed trial 24 with data: {'y': (0.788423, 0.025)}.

[INFO 10-07 20:11:27] ax.service.ax_client: Generated new trial 25 with parameters {'x': 0.905694}.

[INFO 10-07 20:11:27] ax.service.ax_client: Completed trial 25 with data: {'y': (0.832649, 0.025)}.

[INFO 10-07 20:11:28] ax.service.ax_client: Generated new trial 26 with parameters {'x': 0.902107}.

[INFO 10-07 20:11:28] ax.service.ax_client: Completed trial 26 with data: {'y': (0.739111, 0.025)}.

[INFO 10-07 20:11:28] ax.service.ax_client: Generated new trial 27 with parameters {'x': 0.910453}.

[INFO 10-07 20:11:28] ax.service.ax_client: Completed trial 27 with data: {'y': (0.759616, 0.025)}.

[INFO 10-07 20:11:28] ax.service.ax_client: Generated new trial 28 with parameters {'x': 0.903389}.

[INFO 10-07 20:11:28] ax.service.ax_client: Completed trial 28 with data: {'y': (0.712875, 0.025)}.

[INFO 10-07 20:11:29] ax.service.ax_client: Generated new trial 29 with parameters {'x': 0.920343}.

[INFO 10-07 20:11:29] ax.service.ax_client: Completed trial 29 with data: {'y': (0.671007, 0.025)}.

[INFO 10-07 20:11:29] ax.service.ax_client: Generated new trial 30 with parameters {'x': 0.900209}.

[INFO 10-07 20:11:29] ax.service.ax_client: Completed trial 30 with data: {'y': (0.787184, 0.025)}.

[INFO 10-07 20:11:29] ax.service.ax_client: Generated new trial 31 with parameters {'x': 0.907302}.

[INFO 10-07 20:11:29] ax.service.ax_client: Completed trial 31 with data: {'y': (0.734473, 0.025)}.

[INFO 10-07 20:11:30] ax.service.ax_client: Generated new trial 32 with parameters {'x': 0.904379}.

[INFO 10-07 20:11:30] ax.service.ax_client: Completed trial 32 with data: {'y': (0.81599, 0.025)}.

[INFO 10-07 20:11:30] ax.service.ax_client: Generated new trial 33 with parameters {'x': 0.89822}.

[INFO 10-07 20:11:30] ax.service.ax_client: Completed trial 33 with data: {'y': (0.796271, 0.025)}.

[INFO 10-07 20:11:30] ax.service.ax_client: Generated new trial 34 with parameters {'x': 0.913154}.

[INFO 10-07 20:11:30] ax.service.ax_client: Completed trial 34 with data: {'y': (0.697519, 0.025)}.

[INFO 10-07 20:11:31] ax.service.ax_client: Generated new trial 35 with parameters {'x': 0.901563}.

[INFO 10-07 20:11:31] ax.service.ax_client: Completed trial 35 with data: {'y': (0.739254, 0.025)}.

[INFO 10-07 20:11:31] ax.service.ax_client: Generated new trial 36 with parameters {'x': 0.916534}.

[INFO 10-07 20:11:31] ax.service.ax_client: Completed trial 36 with data: {'y': (0.714868, 0.025)}.

[INFO 10-07 20:11:31] ax.service.ax_client: Generated new trial 37 with parameters {'x': 0.894304}.

[INFO 10-07 20:11:31] ax.service.ax_client: Completed trial 37 with data: {'y': (0.818074, 0.025)}.

[INFO 10-07 20:11:32] ax.service.ax_client: Generated new trial 38 with parameters {'x': 0.896}.

[INFO 10-07 20:11:32] ax.service.ax_client: Completed trial 38 with data: {'y': (0.772241, 0.025)}.

[INFO 10-07 20:11:32] ax.service.ax_client: Generated new trial 39 with parameters {'x': 0.902505}.

[INFO 10-07 20:11:32] ax.service.ax_client: Completed trial 39 with data: {'y': (0.799316, 0.025)}.

[INFO 10-07 20:11:32] ax.service.ax_client: Generated new trial 40 with parameters {'x': 0.90062}.

[INFO 10-07 20:11:32] ax.service.ax_client: Completed trial 40 with data: {'y': (0.794909, 0.025)}.

[INFO 10-07 20:11:33] ax.service.ax_client: Generated new trial 41 with parameters {'x': 0.899722}.

[INFO 10-07 20:11:33] ax.service.ax_client: Completed trial 41 with data: {'y': (0.822648, 0.025)}.

[INFO 10-07 20:11:33] ax.service.ax_client: Generated new trial 42 with parameters {'x': 0.898755}.

[INFO 10-07 20:11:33] ax.service.ax_client: Completed trial 42 with data: {'y': (0.823654, 0.025)}.

[INFO 10-07 20:11:33] ax.service.ax_client: Generated new trial 43 with parameters {'x': 0.903094}.

[INFO 10-07 20:11:33] ax.service.ax_client: Completed trial 43 with data: {'y': (0.802765, 0.025)}.

[INFO 10-07 20:11:33] ax.service.ax_client: Generated new trial 44 with parameters {'x': 0.901785}.

[INFO 10-07 20:11:33] ax.service.ax_client: Completed trial 44 with data: {'y': (0.828858, 0.025)}.

[INFO 10-07 20:11:34] ax.service.ax_client: Generated new trial 45 with parameters {'x': 0.897671}.

[INFO 10-07 20:11:34] ax.service.ax_client: Completed trial 45 with data: {'y': (0.763906, 0.025)}.

[INFO 10-07 20:11:34] ax.service.ax_client: Generated new trial 46 with parameters {'x': 0.905219}.

[INFO 10-07 20:11:34] ax.service.ax_client: Completed trial 46 with data: {'y': (0.818205, 0.025)}.

[INFO 10-07 20:11:35] ax.service.ax_client: Generated new trial 47 with parameters {'x': 0.903662}.

[INFO 10-07 20:11:35] ax.service.ax_client: Completed trial 47 with data: {'y': (0.841948, 0.025)}.

[INFO 10-07 20:11:35] ax.service.ax_client: Generated new trial 48 with parameters {'x': 0.901299}.

[INFO 10-07 20:11:35] ax.service.ax_client: Completed trial 48 with data: {'y': (0.809031, 0.025)}.

[INFO 10-07 20:11:35] ax.service.ax_client: Generated new trial 49 with parameters {'x': 0.90417}.

[INFO 10-07 20:11:35] ax.service.ax_client: Completed trial 49 with data: {'y': (0.780235, 0.025)}.

[INFO 10-07 20:11:36] ax.service.ax_client: Generated new trial 50 with parameters {'x': 0.899969}.

[INFO 10-07 20:11:36] ax.service.ax_client: Completed trial 50 with data: {'y': (0.896811, 0.025)}.

[INFO 10-07 20:11:36] ax.service.ax_client: Generated new trial 51 with parameters {'x': 0.900897}.

[INFO 10-07 20:11:36] ax.service.ax_client: Completed trial 51 with data: {'y': (0.799893, 0.025)}.

[INFO 10-07 20:11:36] ax.service.ax_client: Generated new trial 52 with parameters {'x': 0.582008}.

[INFO 10-07 20:11:36] ax.service.ax_client: Completed trial 52 with data: {'y': (0.052013, 0.025)}.

[INFO 10-07 20:11:37] ax.service.ax_client: Generated new trial 53 with parameters {'x': 0.902297}.

[INFO 10-07 20:11:37] ax.service.ax_client: Completed trial 53 with data: {'y': (0.871603, 0.025)}.

[INFO 10-07 20:11:37] ax.service.ax_client: Generated new trial 54 with parameters {'x': 0.90042}.

[INFO 10-07 20:11:37] ax.service.ax_client: Completed trial 54 with data: {'y': (0.899897, 0.025)}.

[INFO 10-07 20:11:38] ax.service.ax_client: Generated new trial 55 with parameters {'x': 0.899469}.

[INFO 10-07 20:11:38] ax.service.ax_client: Completed trial 55 with data: {'y': (0.859466, 0.025)}.

[INFO 10-07 20:11:38] ax.service.ax_client: Generated new trial 56 with parameters {'x': 0.896408}.

[INFO 10-07 20:11:38] ax.service.ax_client: Completed trial 56 with data: {'y': (0.795495, 0.025)}.

[INFO 10-07 20:11:39] ax.service.ax_client: Generated new trial 57 with parameters {'x': 0.900619}.

[INFO 10-07 20:11:39] ax.service.ax_client: Completed trial 57 with data: {'y': (0.854256, 0.025)}.

[INFO 10-07 20:11:39] ax.service.ax_client: Generated new trial 58 with parameters {'x': 0.901178}.

[INFO 10-07 20:11:39] ax.service.ax_client: Completed trial 58 with data: {'y': (0.763959, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:39] ax.service.ax_client: Generated new trial 59 with parameters {'x': 0.894886}.

[INFO 10-07 20:11:39] ax.service.ax_client: Completed trial 59 with data: {'y': (0.770932, 0.025)}.

[INFO 10-07 20:11:40] ax.service.ax_client: Generated new trial 60 with parameters {'x': 0.901684}.

[INFO 10-07 20:11:40] ax.service.ax_client: Completed trial 60 with data: {'y': (0.819886, 0.025)}.

[INFO 10-07 20:11:40] ax.service.ax_client: Generated new trial 61 with parameters {'x': 0.901937}.

[INFO 10-07 20:11:40] ax.service.ax_client: Completed trial 61 with data: {'y': (0.775635, 0.025)}.

[INFO 10-07 20:11:41] ax.service.ax_client: Generated new trial 62 with parameters {'x': 0.900096}.

[INFO 10-07 20:11:41] ax.service.ax_client: Completed trial 62 with data: {'y': (0.833814, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:41] ax.service.ax_client: Generated new trial 63 with parameters {'x': 0.906844}.

[INFO 10-07 20:11:41] ax.service.ax_client: Completed trial 63 with data: {'y': (0.860504, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:42] ax.service.ax_client: Generated new trial 64 with parameters {'x': 0.902542}.

[INFO 10-07 20:11:42] ax.service.ax_client: Completed trial 64 with data: {'y': (0.864232, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:42] ax.service.ax_client: Generated new trial 65 with parameters {'x': 0.902508}.

[INFO 10-07 20:11:42] ax.service.ax_client: Completed trial 65 with data: {'y': (0.764684, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:43] ax.service.ax_client: Generated new trial 66 with parameters {'x': 0.898772}.

[INFO 10-07 20:11:43] ax.service.ax_client: Completed trial 66 with data: {'y': (0.857948, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:43] ax.service.ax_client: Generated new trial 67 with parameters {'x': 0.903169}.

[INFO 10-07 20:11:43] ax.service.ax_client: Completed trial 67 with data: {'y': (0.74951, 0.025)}.

[INFO 10-07 20:11:44] ax.service.ax_client: Generated new trial 68 with parameters {'x': 0.888473}.

[INFO 10-07 20:11:44] ax.service.ax_client: Completed trial 68 with data: {'y': (0.706761, 0.025)}.

[INFO 10-07 20:11:45] ax.service.ax_client: Generated new trial 69 with parameters {'x': 0.892303}.

[INFO 10-07 20:11:45] ax.service.ax_client: Completed trial 69 with data: {'y': (0.822277, 0.025)}.

[INFO 10-07 20:11:45] ax.service.ax_client: Generated new trial 70 with parameters {'x': 0.862142}.

[INFO 10-07 20:11:45] ax.service.ax_client: Completed trial 70 with data: {'y': (0.27556, 0.025)}.

[INFO 10-07 20:11:46] ax.service.ax_client: Generated new trial 71 with parameters {'x': 0.68081}.

[INFO 10-07 20:11:46] ax.service.ax_client: Completed trial 71 with data: {'y': (0.27999, 0.025)}.

[INFO 10-07 20:11:46] ax.service.ax_client: Generated new trial 72 with parameters {'x': 0.706502}.

[INFO 10-07 20:11:46] ax.service.ax_client: Completed trial 72 with data: {'y': (0.491191, 0.025)}.

[INFO 10-07 20:11:47] ax.service.ax_client: Generated new trial 73 with parameters {'x': 0.71761}.

[INFO 10-07 20:11:47] ax.service.ax_client: Completed trial 73 with data: {'y': (0.394718, 0.025)}.

[INFO 10-07 20:11:47] ax.service.ax_client: Generated new trial 74 with parameters {'x': 0.954446}.

[INFO 10-07 20:11:47] ax.service.ax_client: Completed trial 74 with data: {'y': (0.117765, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:48] ax.service.ax_client: Generated new trial 75 with parameters {'x': 0.898431}.

[INFO 10-07 20:11:48] ax.service.ax_client: Completed trial 75 with data: {'y': (0.748845, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:48] ax.service.ax_client: Generated new trial 76 with parameters {'x': 0.901431}.

[INFO 10-07 20:11:48] ax.service.ax_client: Completed trial 76 with data: {'y': (0.755635, 0.025)}.

[INFO 10-07 20:11:49] ax.service.ax_client: Generated new trial 77 with parameters {'x': 0.140219}.

[INFO 10-07 20:11:49] ax.service.ax_client: Completed trial 77 with data: {'y': (0.057083, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:49] ax.service.ax_client: Generated new trial 78 with parameters {'x': 0.899275}.

[INFO 10-07 20:11:49] ax.service.ax_client: Completed trial 78 with data: {'y': (0.79421, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:50] ax.service.ax_client: Generated new trial 79 with parameters {'x': 0.899747}.

[INFO 10-07 20:11:50] ax.service.ax_client: Completed trial 79 with data: {'y': (0.873288, 0.025)}.

[INFO 10-07 20:11:50] ax.service.ax_client: Generated new trial 80 with parameters {'x': 0.769453}.

[INFO 10-07 20:11:50] ax.service.ax_client: Completed trial 80 with data: {'y': (-0.05719, 0.025)}.

[INFO 10-07 20:11:51] ax.service.ax_client: Generated new trial 81 with parameters {'x': 0.446198}.

[INFO 10-07 20:11:51] ax.service.ax_client: Completed trial 81 with data: {'y': (-0.069655, 0.025)}.

[INFO 10-07 20:11:51] ax.service.ax_client: Generated new trial 82 with parameters {'x': 0.496438}.

[INFO 10-07 20:11:51] ax.service.ax_client: Completed trial 82 with data: {'y': (0.225127, 0.025)}.

[INFO 10-07 20:11:51] ax.service.ax_client: Generated new trial 83 with parameters {'x': 0.839617}.

[INFO 10-07 20:11:52] ax.service.ax_client: Completed trial 83 with data: {'y': (-0.008893, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:52] ax.service.ax_client: Generated new trial 84 with parameters {'x': 0.89942}.

[INFO 10-07 20:11:52] ax.service.ax_client: Completed trial 84 with data: {'y': (0.765348, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:53] ax.service.ax_client: Generated new trial 85 with parameters {'x': 0.905779}.

[INFO 10-07 20:11:53] ax.service.ax_client: Completed trial 85 with data: {'y': (0.776258, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:53] ax.service.ax_client: Generated new trial 86 with parameters {'x': 0.900894}.

[INFO 10-07 20:11:53] ax.service.ax_client: Completed trial 86 with data: {'y': (0.704612, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:54] ax.service.ax_client: Generated new trial 87 with parameters {'x': 0.896283}.

[INFO 10-07 20:11:54] ax.service.ax_client: Completed trial 87 with data: {'y': (0.800504, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:55] ax.service.ax_client: Generated new trial 88 with parameters {'x': 0.901177}.

[INFO 10-07 20:11:55] ax.service.ax_client: Completed trial 88 with data: {'y': (0.734111, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:56] ax.service.ax_client: Generated new trial 89 with parameters {'x': 0.900421}.

[INFO 10-07 20:11:56] ax.service.ax_client: Completed trial 89 with data: {'y': (0.849517, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:56] ax.service.ax_client: Generated new trial 90 with parameters {'x': 0.898897}.

[INFO 10-07 20:11:56] ax.service.ax_client: Completed trial 90 with data: {'y': (0.740231, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:57] ax.service.ax_client: Generated new trial 91 with parameters {'x': 0.904627}.

[INFO 10-07 20:11:57] ax.service.ax_client: Completed trial 91 with data: {'y': (0.838651, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:58] ax.service.ax_client: Generated new trial 92 with parameters {'x': 0.903583}.

[INFO 10-07 20:11:58] ax.service.ax_client: Completed trial 92 with data: {'y': (0.920795, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:58] ax.service.ax_client: Generated new trial 93 with parameters {'x': 0.902865}.

[INFO 10-07 20:11:58] ax.service.ax_client: Completed trial 93 with data: {'y': (0.828581, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:11:59] ax.service.ax_client: Generated new trial 94 with parameters {'x': 0.903353}.

[INFO 10-07 20:11:59] ax.service.ax_client: Completed trial 94 with data: {'y': (0.791584, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:00] ax.service.ax_client: Generated new trial 95 with parameters {'x': 0.905057}.

[INFO 10-07 20:12:00] ax.service.ax_client: Completed trial 95 with data: {'y': (0.83065, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:01] ax.service.ax_client: Generated new trial 96 with parameters {'x': 0.904088}.

[INFO 10-07 20:12:01] ax.service.ax_client: Completed trial 96 with data: {'y': (0.794704, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:01] ax.service.ax_client: Generated new trial 97 with parameters {'x': 0.904009}.

[INFO 10-07 20:12:01] ax.service.ax_client: Completed trial 97 with data: {'y': (0.829439, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:02] ax.service.ax_client: Generated new trial 98 with parameters {'x': 0.902185}.

[INFO 10-07 20:12:02] ax.service.ax_client: Completed trial 98 with data: {'y': (0.806187, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 99 with parameters {'x': 0.90618}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 99 with data: {'y': (0.724758, 0.025)}.

[INFO 10-07 20:12:03] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.

[INFO 10-07 20:12:03] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.

[INFO 10-07 20:12:03] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).

[INFO 10-07 20:12:03] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.

[INFO 10-07 20:12:03] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to  model-fitting.

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 0 with parameters {'x': 0.844505}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 0 with data: {'y': (0.066831, 0.025)}.

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 1 with parameters {'x': 0.907884}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 1 with data: {'y': (0.796585, 0.025)}.

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 2 with parameters {'x': 0.642633}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 2 with data: {'y': (0.026822, 0.025)}.

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 3 with parameters {'x': 0.696007}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 3 with data: {'y': (0.480307, 0.025)}.

[INFO 10-07 20:12:03] ax.service.ax_client: Generated new trial 4 with parameters {'x': 0.726506}.

[INFO 10-07 20:12:03] ax.service.ax_client: Completed trial 4 with data: {'y': (0.336552, 0.025)}.

[INFO 10-07 20:12:04] ax.service.ax_client: Generated new trial 5 with parameters {'x': 0.967245}.

[INFO 10-07 20:12:04] ax.service.ax_client: Completed trial 5 with data: {'y': (-0.067406, 0.025)}.

[INFO 10-07 20:12:04] ax.service.ax_client: Generated new trial 6 with parameters {'x': 0.894772}.

[INFO 10-07 20:12:04] ax.service.ax_client: Completed trial 6 with data: {'y': (0.746481, 0.025)}.

[INFO 10-07 20:12:04] ax.service.ax_client: Generated new trial 7 with parameters {'x': 0.0}.

[INFO 10-07 20:12:04] ax.service.ax_client: Completed trial 7 with data: {'y': (-0.034688, 0.025)}.

[INFO 10-07 20:12:04] ax.service.ax_client: Generated new trial 8 with parameters {'x': 0.307702}.

[INFO 10-07 20:12:04] ax.service.ax_client: Completed trial 8 with data: {'y': (0.034658, 0.025)}.

[INFO 10-07 20:12:04] ax.service.ax_client: Generated new trial 9 with parameters {'x': 0.460111}.

[INFO 10-07 20:12:04] ax.service.ax_client: Completed trial 9 with data: {'y': (0.005754, 0.025)}.

[INFO 10-07 20:12:05] ax.service.ax_client: Generated new trial 10 with parameters {'x': 0.161178}.

[INFO 10-07 20:12:05] ax.service.ax_client: Completed trial 10 with data: {'y': (-0.072751, 0.025)}.

[INFO 10-07 20:12:05] ax.service.ax_client: Generated new trial 11 with parameters {'x': 0.903159}.

[INFO 10-07 20:12:05] ax.service.ax_client: Completed trial 11 with data: {'y': (0.787172, 0.025)}.

[INFO 10-07 20:12:05] ax.service.ax_client: Generated new trial 12 with parameters {'x': 0.916011}.

[INFO 10-07 20:12:05] ax.service.ax_client: Completed trial 12 with data: {'y': (0.775004, 0.025)}.

[INFO 10-07 20:12:05] ax.service.ax_client: Generated new trial 13 with parameters {'x': 0.544839}.

[INFO 10-07 20:12:05] ax.service.ax_client: Completed trial 13 with data: {'y': (0.09517, 0.025)}.

[INFO 10-07 20:12:06] ax.service.ax_client: Generated new trial 14 with parameters {'x': 0.382451}.

[INFO 10-07 20:12:06] ax.service.ax_client: Completed trial 14 with data: {'y': (0.063616, 0.025)}.

[INFO 10-07 20:12:06] ax.service.ax_client: Generated new trial 15 with parameters {'x': 0.079397}.

[INFO 10-07 20:12:06] ax.service.ax_client: Completed trial 15 with data: {'y': (0.016053, 0.025)}.

[INFO 10-07 20:12:06] ax.service.ax_client: Generated new trial 16 with parameters {'x': 0.910635}.

[INFO 10-07 20:12:06] ax.service.ax_client: Completed trial 16 with data: {'y': (0.67797, 0.025)}.

[INFO 10-07 20:12:06] ax.service.ax_client: Generated new trial 17 with parameters {'x': 0.237683}.

[INFO 10-07 20:12:06] ax.service.ax_client: Completed trial 17 with data: {'y': (-0.049262, 0.025)}.

[INFO 10-07 20:12:07] ax.service.ax_client: Generated new trial 18 with parameters {'x': 0.900035}.

[INFO 10-07 20:12:07] ax.service.ax_client: Completed trial 18 with data: {'y': (0.833213, 0.025)}.

[INFO 10-07 20:12:07] ax.service.ax_client: Generated new trial 19 with parameters {'x': 0.926679}.

[INFO 10-07 20:12:07] ax.service.ax_client: Completed trial 19 with data: {'y': (0.54743, 0.025)}.

[INFO 10-07 20:12:08] ax.service.ax_client: Generated new trial 20 with parameters {'x': 0.901774}.

[INFO 10-07 20:12:08] ax.service.ax_client: Completed trial 20 with data: {'y': (0.87141, 0.025)}.

[INFO 10-07 20:12:08] ax.service.ax_client: Generated new trial 21 with parameters {'x': 0.677092}.

[INFO 10-07 20:12:08] ax.service.ax_client: Completed trial 21 with data: {'y': (0.373978, 0.025)}.

[INFO 10-07 20:12:08] ax.service.ax_client: Generated new trial 22 with parameters {'x': 0.877376}.

[INFO 10-07 20:12:08] ax.service.ax_client: Completed trial 22 with data: {'y': (0.571422, 0.025)}.

[INFO 10-07 20:12:08] ax.service.ax_client: Generated new trial 23 with parameters {'x': 0.898361}.

[INFO 10-07 20:12:08] ax.service.ax_client: Completed trial 23 with data: {'y': (0.773623, 0.025)}.

[INFO 10-07 20:12:09] ax.service.ax_client: Generated new trial 24 with parameters {'x': 0.904576}.

[INFO 10-07 20:12:09] ax.service.ax_client: Completed trial 24 with data: {'y': (0.85331, 0.025)}.

[INFO 10-07 20:12:09] ax.service.ax_client: Generated new trial 25 with parameters {'x': 0.900916}.

[INFO 10-07 20:12:09] ax.service.ax_client: Completed trial 25 with data: {'y': (0.868879, 0.025)}.

[INFO 10-07 20:12:09] ax.service.ax_client: Generated new trial 26 with parameters {'x': 0.756843}.

[INFO 10-07 20:12:09] ax.service.ax_client: Completed trial 26 with data: {'y': (0.126826, 0.025)}.

[INFO 10-07 20:12:09] ax.service.ax_client: Generated new trial 27 with parameters {'x': 0.590471}.

[INFO 10-07 20:12:09] ax.service.ax_client: Completed trial 27 with data: {'y': (0.072891, 0.025)}.

[INFO 10-07 20:12:09] ax.service.ax_client: Generated new trial 28 with parameters {'x': 0.79801}.

[INFO 10-07 20:12:09] ax.service.ax_client: Completed trial 28 with data: {'y': (0.037203, 0.025)}.

[INFO 10-07 20:12:10] ax.service.ax_client: Generated new trial 29 with parameters {'x': 0.902486}.

[INFO 10-07 20:12:10] ax.service.ax_client: Completed trial 29 with data: {'y': (0.792399, 0.025)}.

[INFO 10-07 20:12:10] ax.service.ax_client: Generated new trial 30 with parameters {'x': 0.903759}.

[INFO 10-07 20:12:10] ax.service.ax_client: Completed trial 30 with data: {'y': (0.851723, 0.025)}.

[INFO 10-07 20:12:10] ax.service.ax_client: Generated new trial 31 with parameters {'x': 0.905527}.

[INFO 10-07 20:12:10] ax.service.ax_client: Completed trial 31 with data: {'y': (0.789473, 0.025)}.

[INFO 10-07 20:12:10] ax.service.ax_client: Generated new trial 32 with parameters {'x': 0.899169}.

[INFO 10-07 20:12:10] ax.service.ax_client: Completed trial 32 with data: {'y': (0.923256, 0.025)}.

[INFO 10-07 20:12:11] ax.service.ax_client: Generated new trial 33 with parameters {'x': 0.900504}.

[INFO 10-07 20:12:11] ax.service.ax_client: Completed trial 33 with data: {'y': (0.753781, 0.025)}.

[INFO 10-07 20:12:11] ax.service.ax_client: Generated new trial 34 with parameters {'x': 0.896854}.

[INFO 10-07 20:12:11] ax.service.ax_client: Completed trial 34 with data: {'y': (0.840908, 0.025)}.

[INFO 10-07 20:12:11] ax.service.ax_client: Generated new trial 35 with parameters {'x': 0.901336}.

[INFO 10-07 20:12:11] ax.service.ax_client: Completed trial 35 with data: {'y': (0.814001, 0.025)}.

[INFO 10-07 20:12:11] ax.service.ax_client: Generated new trial 36 with parameters {'x': 0.899614}.

[INFO 10-07 20:12:11] ax.service.ax_client: Completed trial 36 with data: {'y': (0.758775, 0.025)}.

[INFO 10-07 20:12:12] ax.service.ax_client: Generated new trial 37 with parameters {'x': 0.902108}.

[INFO 10-07 20:12:12] ax.service.ax_client: Completed trial 37 with data: {'y': (0.77323, 0.025)}.

[INFO 10-07 20:12:12] ax.service.ax_client: Generated new trial 38 with parameters {'x': 0.897471}.

[INFO 10-07 20:12:12] ax.service.ax_client: Completed trial 38 with data: {'y': (0.812646, 0.025)}.

[INFO 10-07 20:12:12] ax.service.ax_client: Generated new trial 39 with parameters {'x': 0.898774}.

[INFO 10-07 20:12:12] ax.service.ax_client: Completed trial 39 with data: {'y': (0.769166, 0.025)}.

[INFO 10-07 20:12:12] ax.service.ax_client: Generated new trial 40 with parameters {'x': 0.902822}.

[INFO 10-07 20:12:12] ax.service.ax_client: Completed trial 40 with data: {'y': (0.79565, 0.025)}.

[INFO 10-07 20:12:13] ax.service.ax_client: Generated new trial 41 with parameters {'x': 0.895882}.

[INFO 10-07 20:12:13] ax.service.ax_client: Completed trial 41 with data: {'y': (0.838884, 0.025)}.

[INFO 10-07 20:12:13] ax.service.ax_client: Generated new trial 42 with parameters {'x': 0.901564}.

[INFO 10-07 20:12:13] ax.service.ax_client: Completed trial 42 with data: {'y': (0.86034, 0.025)}.

[INFO 10-07 20:12:13] ax.service.ax_client: Generated new trial 43 with parameters {'x': 0.901122}.

[INFO 10-07 20:12:13] ax.service.ax_client: Completed trial 43 with data: {'y': (0.762372, 0.025)}.

[INFO 10-07 20:12:13] ax.service.ax_client: Generated new trial 44 with parameters {'x': 0.897866}.

[INFO 10-07 20:12:13] ax.service.ax_client: Completed trial 44 with data: {'y': (0.95107, 0.025)}.

[INFO 10-07 20:12:14] ax.service.ax_client: Generated new trial 45 with parameters {'x': 0.919501}.

[INFO 10-07 20:12:14] ax.service.ax_client: Completed trial 45 with data: {'y': (0.668593, 0.025)}.

[INFO 10-07 20:12:14] ax.service.ax_client: Generated new trial 46 with parameters {'x': 0.900273}.

[INFO 10-07 20:12:14] ax.service.ax_client: Completed trial 46 with data: {'y': (0.839921, 0.025)}.

[INFO 10-07 20:12:14] ax.service.ax_client: Generated new trial 47 with parameters {'x': 0.896318}.

[INFO 10-07 20:12:14] ax.service.ax_client: Completed trial 47 with data: {'y': (0.791438, 0.025)}.

[INFO 10-07 20:12:15] ax.service.ax_client: Generated new trial 48 with parameters {'x': 0.899418}.

[INFO 10-07 20:12:15] ax.service.ax_client: Completed trial 48 with data: {'y': (0.835223, 0.025)}.

[INFO 10-07 20:12:15] ax.service.ax_client: Generated new trial 49 with parameters {'x': 0.899611}.

[INFO 10-07 20:12:15] ax.service.ax_client: Completed trial 49 with data: {'y': (0.858738, 0.025)}.

[INFO 10-07 20:12:15] ax.service.ax_client: Generated new trial 50 with parameters {'x': 0.899461}.

[INFO 10-07 20:12:15] ax.service.ax_client: Completed trial 50 with data: {'y': (0.903345, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:16] ax.service.ax_client: Generated new trial 51 with parameters {'x': 0.89883}.

[INFO 10-07 20:12:16] ax.service.ax_client: Completed trial 51 with data: {'y': (0.809671, 0.025)}.

[INFO 10-07 20:12:16] ax.service.ax_client: Generated new trial 52 with parameters {'x': 0.898099}.

[INFO 10-07 20:12:16] ax.service.ax_client: Completed trial 52 with data: {'y': (0.849681, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:16] ax.service.ax_client: Generated new trial 53 with parameters {'x': 0.899917}.

[INFO 10-07 20:12:16] ax.service.ax_client: Completed trial 53 with data: {'y': (0.890028, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:17] ax.service.ax_client: Generated new trial 54 with parameters {'x': 0.898531}.

[INFO 10-07 20:12:17] ax.service.ax_client: Completed trial 54 with data: {'y': (0.719752, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:17] ax.service.ax_client: Generated new trial 55 with parameters {'x': 0.897202}.

[INFO 10-07 20:12:17] ax.service.ax_client: Completed trial 55 with data: {'y': (0.842076, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:17] ax.service.ax_client: Generated new trial 56 with parameters {'x': 0.900729}.

[INFO 10-07 20:12:17] ax.service.ax_client: Completed trial 56 with data: {'y': (0.854726, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:18] ax.service.ax_client: Generated new trial 57 with parameters {'x': 0.900957}.

[INFO 10-07 20:12:18] ax.service.ax_client: Completed trial 57 with data: {'y': (0.774713, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:18] ax.service.ax_client: Generated new trial 58 with parameters {'x': 0.899093}.

[INFO 10-07 20:12:18] ax.service.ax_client: Completed trial 58 with data: {'y': (0.952391, 0.025)}.

[INFO 10-07 20:12:18] ax.service.ax_client: Generated new trial 59 with parameters {'x': 0.899774}.

[INFO 10-07 20:12:18] ax.service.ax_client: Completed trial 59 with data: {'y': (0.7489, 0.025)}.

[INFO 10-07 20:12:19] ax.service.ax_client: Generated new trial 60 with parameters {'x': 0.899414}.

[INFO 10-07 20:12:19] ax.service.ax_client: Completed trial 60 with data: {'y': (0.861163, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:19] ax.service.ax_client: Generated new trial 61 with parameters {'x': 0.903979}.

[INFO 10-07 20:12:19] ax.service.ax_client: Completed trial 61 with data: {'y': (0.762539, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:20] ax.service.ax_client: Generated new trial 62 with parameters {'x': 0.897706}.

[INFO 10-07 20:12:20] ax.service.ax_client: Completed trial 62 with data: {'y': (0.743152, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:20] ax.service.ax_client: Generated new trial 63 with parameters {'x': 0.900162}.

[INFO 10-07 20:12:20] ax.service.ax_client: Completed trial 63 with data: {'y': (0.825431, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:21] ax.service.ax_client: Generated new trial 64 with parameters {'x': 0.898278}.

[INFO 10-07 20:12:21] ax.service.ax_client: Completed trial 64 with data: {'y': (0.766352, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:21] ax.service.ax_client: Generated new trial 65 with parameters {'x': 0.895339}.

[INFO 10-07 20:12:21] ax.service.ax_client: Completed trial 65 with data: {'y': (0.855274, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:21] ax.service.ax_client: Generated new trial 66 with parameters {'x': 0.898964}.

[INFO 10-07 20:12:21] ax.service.ax_client: Completed trial 66 with data: {'y': (0.812652, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:22] ax.service.ax_client: Generated new trial 67 with parameters {'x': 0.899096}.

[INFO 10-07 20:12:22] ax.service.ax_client: Completed trial 67 with data: {'y': (0.817691, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:22] ax.service.ax_client: Generated new trial 68 with parameters {'x': 0.897351}.

[INFO 10-07 20:12:22] ax.service.ax_client: Completed trial 68 with data: {'y': (0.75445, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:23] ax.service.ax_client: Generated new trial 69 with parameters {'x': 0.900582}.

[INFO 10-07 20:12:23] ax.service.ax_client: Completed trial 69 with data: {'y': (0.867504, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:23] ax.service.ax_client: Generated new trial 70 with parameters {'x': 0.898572}.

[INFO 10-07 20:12:23] ax.service.ax_client: Completed trial 70 with data: {'y': (0.716598, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:24] ax.service.ax_client: Generated new trial 71 with parameters {'x': 0.899779}.

[INFO 10-07 20:12:24] ax.service.ax_client: Completed trial 71 with data: {'y': (0.812805, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:24] ax.service.ax_client: Generated new trial 72 with parameters {'x': 0.901302}.

[INFO 10-07 20:12:24] ax.service.ax_client: Completed trial 72 with data: {'y': (0.852704, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:25] ax.service.ax_client: Generated new trial 73 with parameters {'x': 0.89985}.

[INFO 10-07 20:12:25] ax.service.ax_client: Completed trial 73 with data: {'y': (0.882538, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:26] ax.service.ax_client: Generated new trial 74 with parameters {'x': 0.901871}.

[INFO 10-07 20:12:26] ax.service.ax_client: Completed trial 74 with data: {'y': (0.799042, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:26] ax.service.ax_client: Generated new trial 75 with parameters {'x': 0.900274}.

[INFO 10-07 20:12:26] ax.service.ax_client: Completed trial 75 with data: {'y': (0.789626, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:27] ax.service.ax_client: Generated new trial 76 with parameters {'x': 0.902523}.

[INFO 10-07 20:12:27] ax.service.ax_client: Completed trial 76 with data: {'y': (0.759463, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:28] ax.service.ax_client: Generated new trial 77 with parameters {'x': 0.899764}.

[INFO 10-07 20:12:28] ax.service.ax_client: Completed trial 77 with data: {'y': (0.975677, 0.025)}.

[INFO 10-07 20:12:29] ax.service.ax_client: Generated new trial 78 with parameters {'x': 0.888807}.

[INFO 10-07 20:12:29] ax.service.ax_client: Completed trial 78 with data: {'y': (0.706728, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:29] ax.service.ax_client: Generated new trial 79 with parameters {'x': 0.899279}.

[INFO 10-07 20:12:29] ax.service.ax_client: Completed trial 79 with data: {'y': (0.744716, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:30] ax.service.ax_client: Generated new trial 80 with parameters {'x': 0.898714}.

[INFO 10-07 20:12:30] ax.service.ax_client: Completed trial 80 with data: {'y': (0.758443, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:30] ax.service.ax_client: Generated new trial 81 with parameters {'x': 0.900371}.

[INFO 10-07 20:12:30] ax.service.ax_client: Completed trial 81 with data: {'y': (0.82571, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:31] ax.service.ax_client: Generated new trial 82 with parameters {'x': 0.896316}.

[INFO 10-07 20:12:31] ax.service.ax_client: Completed trial 82 with data: {'y': (0.806205, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:31] ax.service.ax_client: Generated new trial 83 with parameters {'x': 0.900766}.

[INFO 10-07 20:12:31] ax.service.ax_client: Completed trial 83 with data: {'y': (0.714276, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:32] ax.service.ax_client: Generated new trial 84 with parameters {'x': 0.903468}.

[INFO 10-07 20:12:32] ax.service.ax_client: Completed trial 84 with data: {'y': (0.872651, 0.025)}.

[INFO 10-07 20:12:33] ax.service.ax_client: Generated new trial 85 with parameters {'x': 0.904949}.

[INFO 10-07 20:12:33] ax.service.ax_client: Completed trial 85 with data: {'y': (0.795327, 0.025)}.

[INFO 10-07 20:12:34] ax.service.ax_client: Generated new trial 86 with parameters {'x': 0.907115}.

[INFO 10-07 20:12:34] ax.service.ax_client: Completed trial 86 with data: {'y': (0.814276, 0.025)}.

[INFO 10-07 20:12:35] ax.service.ax_client: Generated new trial 87 with parameters {'x': 0.90637}.

[INFO 10-07 20:12:35] ax.service.ax_client: Completed trial 87 with data: {'y': (0.745062, 0.025)}.

[INFO 10-07 20:12:35] ax.service.ax_client: Generated new trial 88 with parameters {'x': 0.91678}.

[INFO 10-07 20:12:35] ax.service.ax_client: Completed trial 88 with data: {'y': (0.652628, 0.025)}.

[INFO 10-07 20:12:36] ax.service.ax_client: Generated new trial 89 with parameters {'x': 0.915233}.

[INFO 10-07 20:12:36] ax.service.ax_client: Completed trial 89 with data: {'y': (0.701739, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:37] ax.service.ax_client: Generated new trial 90 with parameters {'x': 0.900304}.

[INFO 10-07 20:12:37] ax.service.ax_client: Completed trial 90 with data: {'y': (0.891287, 0.025)}.

[INFO 10-07 20:12:38] ax.service.ax_client: Generated new trial 91 with parameters {'x': 0.908845}.

[INFO 10-07 20:12:38] ax.service.ax_client: Completed trial 91 with data: {'y': (0.800571, 0.025)}.

[INFO 10-07 20:12:39] ax.service.ax_client: Generated new trial 92 with parameters {'x': 0.908393}.

[INFO 10-07 20:12:39] ax.service.ax_client: Completed trial 92 with data: {'y': (0.713504, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:39] ax.service.ax_client: Generated new trial 93 with parameters {'x': 0.900074}.

[INFO 10-07 20:12:39] ax.service.ax_client: Completed trial 93 with data: {'y': (0.859092, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:40] ax.service.ax_client: Generated new trial 94 with parameters {'x': 0.901204}.

[INFO 10-07 20:12:40] ax.service.ax_client: Completed trial 94 with data: {'y': (0.828771, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:40] ax.service.ax_client: Generated new trial 95 with parameters {'x': 0.900503}.

[INFO 10-07 20:12:40] ax.service.ax_client: Completed trial 95 with data: {'y': (0.854948, 0.025)}.

[INFO 10-07 20:12:41] ax.service.ax_client: Generated new trial 96 with parameters {'x': 0.909471}.

[INFO 10-07 20:12:41] ax.service.ax_client: Completed trial 96 with data: {'y': (0.787949, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:42] ax.service.ax_client: Generated new trial 97 with parameters {'x': 0.901009}.

[INFO 10-07 20:12:42] ax.service.ax_client: Completed trial 97 with data: {'y': (0.819518, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:12:43] ax.service.ax_client: Generated new trial 98 with parameters {'x': 0.900599}.

[INFO 10-07 20:12:43] ax.service.ax_client: Completed trial 98 with data: {'y': (0.857807, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 99 with parameters {'x': 0.895583}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 99 with data: {'y': (0.767186, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.

[INFO 10-07 20:12:44] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicity specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.

[INFO 10-07 20:12:44] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[]).

[INFO 10-07 20:12:44] ax.modelbridge.dispatch_utils: Using Bayesian optimization since there are more ordered parameters than there are categories for the unordered categorical parameters.

[INFO 10-07 20:12:44] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+GPEI', steps=[Sobol for 5 trials, GPEI for subsequent trials]). Iterations after 5 will take longer to generate due to  model-fitting.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 0 with parameters {'x': 0.370868}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 0 with data: {'y': (0.03296, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 1 with parameters {'x': 0.831482}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 1 with data: {'y': (0.07279, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 2 with parameters {'x': 0.352219}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 2 with data: {'y': (-0.052842, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 3 with parameters {'x': 0.459171}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 3 with data: {'y': (0.091327, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 4 with parameters {'x': 0.137471}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 4 with data: {'y': (-0.020905, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 5 with parameters {'x': 0.601439}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 5 with data: {'y': (-0.015004, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 6 with parameters {'x': 0.944688}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 6 with data: {'y': (0.222737, 0.025)}.

[INFO 10-07 20:12:44] ax.service.ax_client: Generated new trial 7 with parameters {'x': 1.0}.

[INFO 10-07 20:12:44] ax.service.ax_client: Completed trial 7 with data: {'y': (-0.078008, 0.025)}.

[INFO 10-07 20:12:45] ax.service.ax_client: Generated new trial 8 with parameters {'x': 0.922803}.

[INFO 10-07 20:12:45] ax.service.ax_client: Completed trial 8 with data: {'y': (0.575005, 0.025)}.

[INFO 10-07 20:12:45] ax.service.ax_client: Generated new trial 9 with parameters {'x': 0.908748}.

[INFO 10-07 20:12:45] ax.service.ax_client: Completed trial 9 with data: {'y': (0.81254, 0.025)}.

[INFO 10-07 20:12:46] ax.service.ax_client: Generated new trial 10 with parameters {'x': 0.895764}.

[INFO 10-07 20:12:46] ax.service.ax_client: Completed trial 10 with data: {'y': (0.788784, 0.025)}.

[INFO 10-07 20:12:46] ax.service.ax_client: Generated new trial 11 with parameters {'x': 0.902756}.

[INFO 10-07 20:12:46] ax.service.ax_client: Completed trial 11 with data: {'y': (0.836842, 0.025)}.

[INFO 10-07 20:12:46] ax.service.ax_client: Generated new trial 12 with parameters {'x': 0.0}.

[INFO 10-07 20:12:46] ax.service.ax_client: Completed trial 12 with data: {'y': (0.004214, 0.025)}.

[INFO 10-07 20:12:46] ax.service.ax_client: Generated new trial 13 with parameters {'x': 0.714023}.

[INFO 10-07 20:12:46] ax.service.ax_client: Completed trial 13 with data: {'y': (0.366103, 0.025)}.

[INFO 10-07 20:12:47] ax.service.ax_client: Generated new trial 14 with parameters {'x': 0.904777}.

[INFO 10-07 20:12:47] ax.service.ax_client: Completed trial 14 with data: {'y': (0.818787, 0.025)}.

[INFO 10-07 20:12:47] ax.service.ax_client: Generated new trial 15 with parameters {'x': 0.758423}.

[INFO 10-07 20:12:47] ax.service.ax_client: Completed trial 15 with data: {'y': (-0.033786, 0.025)}.

[INFO 10-07 20:12:47] ax.service.ax_client: Generated new trial 16 with parameters {'x': 0.671516}.

[INFO 10-07 20:12:47] ax.service.ax_client: Completed trial 16 with data: {'y': (0.271402, 0.025)}.

[INFO 10-07 20:12:48] ax.service.ax_client: Generated new trial 17 with parameters {'x': 0.900511}.

[INFO 10-07 20:12:48] ax.service.ax_client: Completed trial 17 with data: {'y': (0.735895, 0.025)}.

[INFO 10-07 20:12:48] ax.service.ax_client: Generated new trial 18 with parameters {'x': 0.883493}.

[INFO 10-07 20:12:48] ax.service.ax_client: Completed trial 18 with data: {'y': (0.637947, 0.025)}.

[INFO 10-07 20:12:48] ax.service.ax_client: Generated new trial 19 with parameters {'x': 0.237947}.

[INFO 10-07 20:12:48] ax.service.ax_client: Completed trial 19 with data: {'y': (0.101039, 0.025)}.

[INFO 10-07 20:12:48] ax.service.ax_client: Generated new trial 20 with parameters {'x': 0.906111}.

[INFO 10-07 20:12:48] ax.service.ax_client: Completed trial 20 with data: {'y': (0.746303, 0.025)}.

[INFO 10-07 20:12:49] ax.service.ax_client: Generated new trial 21 with parameters {'x': 0.901752}.

[INFO 10-07 20:12:49] ax.service.ax_client: Completed trial 21 with data: {'y': (0.94795, 0.025)}.

[INFO 10-07 20:12:49] ax.service.ax_client: Generated new trial 22 with parameters {'x': 0.893495}.

[INFO 10-07 20:12:49] ax.service.ax_client: Completed trial 22 with data: {'y': (0.794254, 0.025)}.

[INFO 10-07 20:12:49] ax.service.ax_client: Generated new trial 23 with parameters {'x': 0.911239}.

[INFO 10-07 20:12:49] ax.service.ax_client: Completed trial 23 with data: {'y': (0.659948, 0.025)}.

[INFO 10-07 20:12:50] ax.service.ax_client: Generated new trial 24 with parameters {'x': 0.888827}.

[INFO 10-07 20:12:50] ax.service.ax_client: Completed trial 24 with data: {'y': (0.693157, 0.025)}.

[INFO 10-07 20:12:51] ax.service.ax_client: Generated new trial 25 with parameters {'x': 0.91805}.

[INFO 10-07 20:12:51] ax.service.ax_client: Completed trial 25 with data: {'y': (0.65798, 0.025)}.

[INFO 10-07 20:12:51] ax.service.ax_client: Generated new trial 26 with parameters {'x': 0.526558}.

[INFO 10-07 20:12:51] ax.service.ax_client: Completed trial 26 with data: {'y': (0.129772, 0.025)}.

[INFO 10-07 20:12:51] ax.service.ax_client: Generated new trial 27 with parameters {'x': 0.877004}.

[INFO 10-07 20:12:51] ax.service.ax_client: Completed trial 27 with data: {'y': (0.530017, 0.025)}.

[INFO 10-07 20:12:51] ax.service.ax_client: Generated new trial 28 with parameters {'x': 0.868307}.

[INFO 10-07 20:12:51] ax.service.ax_client: Completed trial 28 with data: {'y': (0.333573, 0.025)}.

[INFO 10-07 20:12:52] ax.service.ax_client: Generated new trial 29 with parameters {'x': 0.931359}.

[INFO 10-07 20:12:52] ax.service.ax_client: Completed trial 29 with data: {'y': (0.321891, 0.025)}.

[INFO 10-07 20:12:52] ax.service.ax_client: Generated new trial 30 with parameters {'x': 0.702936}.

[INFO 10-07 20:12:52] ax.service.ax_client: Completed trial 30 with data: {'y': (0.524867, 0.025)}.

[INFO 10-07 20:12:53] ax.service.ax_client: Generated new trial 31 with parameters {'x': 0.694692}.

[INFO 10-07 20:12:53] ax.service.ax_client: Completed trial 31 with data: {'y': (0.386978, 0.025)}.

[INFO 10-07 20:12:53] ax.service.ax_client: Generated new trial 32 with parameters {'x': 0.899383}.

[INFO 10-07 20:12:53] ax.service.ax_client: Completed trial 32 with data: {'y': (0.722274, 0.025)}.

[INFO 10-07 20:12:54] ax.service.ax_client: Generated new trial 33 with parameters {'x': 0.902306}.

[INFO 10-07 20:12:54] ax.service.ax_client: Completed trial 33 with data: {'y': (0.827586, 0.025)}.

[INFO 10-07 20:12:54] ax.service.ax_client: Generated new trial 34 with parameters {'x': 0.728557}.

[INFO 10-07 20:12:54] ax.service.ax_client: Completed trial 34 with data: {'y': (0.300208, 0.025)}.

[INFO 10-07 20:12:54] ax.service.ax_client: Generated new trial 35 with parameters {'x': 0.653806}.

[INFO 10-07 20:12:54] ax.service.ax_client: Completed trial 35 with data: {'y': (0.123611, 0.025)}.

[INFO 10-07 20:12:55] ax.service.ax_client: Generated new trial 36 with parameters {'x': 0.072315}.

[INFO 10-07 20:12:55] ax.service.ax_client: Completed trial 36 with data: {'y': (0.088917, 0.025)}.

[INFO 10-07 20:12:55] ax.service.ax_client: Generated new trial 37 with parameters {'x': 0.293394}.

[INFO 10-07 20:12:55] ax.service.ax_client: Completed trial 37 with data: {'y': (-0.01324, 0.025)}.

[INFO 10-07 20:12:55] ax.service.ax_client: Generated new trial 38 with parameters {'x': 0.903208}.

[INFO 10-07 20:12:55] ax.service.ax_client: Completed trial 38 with data: {'y': (0.839493, 0.025)}.

[INFO 10-07 20:12:56] ax.service.ax_client: Generated new trial 39 with parameters {'x': 0.191908}.

[INFO 10-07 20:12:56] ax.service.ax_client: Completed trial 39 with data: {'y': (-0.008754, 0.025)}.

[INFO 10-07 20:12:56] ax.service.ax_client: Generated new trial 40 with parameters {'x': 0.903785}.

[INFO 10-07 20:12:56] ax.service.ax_client: Completed trial 40 with data: {'y': (0.82817, 0.025)}.

[INFO 10-07 20:12:56] ax.service.ax_client: Generated new trial 41 with parameters {'x': 0.901208}.

[INFO 10-07 20:12:56] ax.service.ax_client: Completed trial 41 with data: {'y': (0.811297, 0.025)}.

[INFO 10-07 20:12:57] ax.service.ax_client: Generated new trial 42 with parameters {'x': 0.904228}.

[INFO 10-07 20:12:57] ax.service.ax_client: Completed trial 42 with data: {'y': (0.780754, 0.025)}.

[INFO 10-07 20:12:57] ax.service.ax_client: Generated new trial 43 with parameters {'x': 0.964818}.

[INFO 10-07 20:12:57] ax.service.ax_client: Completed trial 43 with data: {'y': (0.068045, 0.025)}.

[INFO 10-07 20:12:57] ax.service.ax_client: Generated new trial 44 with parameters {'x': 0.415906}.

[INFO 10-07 20:12:57] ax.service.ax_client: Completed trial 44 with data: {'y': (0.046873, 0.025)}.

[INFO 10-07 20:12:58] ax.service.ax_client: Generated new trial 45 with parameters {'x': 0.892407}.

[INFO 10-07 20:12:58] ax.service.ax_client: Completed trial 45 with data: {'y': (0.831059, 0.025)}.

[INFO 10-07 20:12:58] ax.service.ax_client: Generated new trial 46 with parameters {'x': 0.560938}.

[INFO 10-07 20:12:58] ax.service.ax_client: Completed trial 46 with data: {'y': (0.02216, 0.025)}.

[INFO 10-07 20:12:58] ax.service.ax_client: Generated new trial 47 with parameters {'x': 0.902518}.

[INFO 10-07 20:12:58] ax.service.ax_client: Completed trial 47 with data: {'y': (0.710346, 0.025)}.

[INFO 10-07 20:12:58] ax.service.ax_client: Generated new trial 48 with parameters {'x': 0.897987}.

[INFO 10-07 20:12:58] ax.service.ax_client: Completed trial 48 with data: {'y': (0.823378, 0.025)}.

[INFO 10-07 20:12:59] ax.service.ax_client: Generated new trial 49 with parameters {'x': 0.898747}.

[INFO 10-07 20:12:59] ax.service.ax_client: Completed trial 49 with data: {'y': (0.891619, 0.025)}.

[INFO 10-07 20:12:59] ax.service.ax_client: Generated new trial 50 with parameters {'x': 0.899881}.

[INFO 10-07 20:12:59] ax.service.ax_client: Completed trial 50 with data: {'y': (0.731736, 0.025)}.

[INFO 10-07 20:12:59] ax.service.ax_client: Generated new trial 51 with parameters {'x': 0.897148}.

[INFO 10-07 20:12:59] ax.service.ax_client: Completed trial 51 with data: {'y': (0.782741, 0.025)}.

[INFO 10-07 20:12:59] ax.service.ax_client: Generated new trial 52 with parameters {'x': 0.900851}.

[INFO 10-07 20:12:59] ax.service.ax_client: Completed trial 52 with data: {'y': (0.769111, 0.025)}.

[INFO 10-07 20:13:00] ax.service.ax_client: Generated new trial 53 with parameters {'x': 0.893994}.

[INFO 10-07 20:13:00] ax.service.ax_client: Completed trial 53 with data: {'y': (0.794398, 0.025)}.

[INFO 10-07 20:13:00] ax.service.ax_client: Generated new trial 54 with parameters {'x': 0.896496}.

[INFO 10-07 20:13:00] ax.service.ax_client: Completed trial 54 with data: {'y': (0.84687, 0.025)}.

[INFO 10-07 20:13:00] ax.service.ax_client: Generated new trial 55 with parameters {'x': 0.899118}.

[INFO 10-07 20:13:00] ax.service.ax_client: Completed trial 55 with data: {'y': (0.735974, 0.025)}.

[INFO 10-07 20:13:01] ax.service.ax_client: Generated new trial 56 with parameters {'x': 0.89527}.

[INFO 10-07 20:13:01] ax.service.ax_client: Completed trial 56 with data: {'y': (0.780025, 0.025)}.

[INFO 10-07 20:13:01] ax.service.ax_client: Generated new trial 57 with parameters {'x': 0.89756}.

[INFO 10-07 20:13:01] ax.service.ax_client: Completed trial 57 with data: {'y': (0.732867, 0.025)}.

[INFO 10-07 20:13:01] ax.service.ax_client: Generated new trial 58 with parameters {'x': 0.894787}.

[INFO 10-07 20:13:01] ax.service.ax_client: Completed trial 58 with data: {'y': (0.782018, 0.025)}.

[INFO 10-07 20:13:02] ax.service.ax_client: Generated new trial 59 with parameters {'x': 0.904501}.

[INFO 10-07 20:13:02] ax.service.ax_client: Completed trial 59 with data: {'y': (0.8002, 0.025)}.

[INFO 10-07 20:13:02] ax.service.ax_client: Generated new trial 60 with parameters {'x': 0.905193}.

[INFO 10-07 20:13:02] ax.service.ax_client: Completed trial 60 with data: {'y': (0.861194, 0.025)}.

[INFO 10-07 20:13:02] ax.service.ax_client: Generated new trial 61 with parameters {'x': 0.49382}.

[INFO 10-07 20:13:02] ax.service.ax_client: Completed trial 61 with data: {'y': (0.208643, 0.025)}.

[INFO 10-07 20:13:03] ax.service.ax_client: Generated new trial 62 with parameters {'x': 0.903458}.

[INFO 10-07 20:13:03] ax.service.ax_client: Completed trial 62 with data: {'y': (0.787636, 0.025)}.

[INFO 10-07 20:13:03] ax.service.ax_client: Generated new trial 63 with parameters {'x': 0.903998}.

[INFO 10-07 20:13:03] ax.service.ax_client: Completed trial 63 with data: {'y': (0.786499, 0.025)}.

[INFO 10-07 20:13:03] ax.service.ax_client: Generated new trial 64 with parameters {'x': 0.905669}.

[INFO 10-07 20:13:03] ax.service.ax_client: Completed trial 64 with data: {'y': (0.798682, 0.025)}.

[INFO 10-07 20:13:04] ax.service.ax_client: Generated new trial 65 with parameters {'x': 0.907888}.

[INFO 10-07 20:13:04] ax.service.ax_client: Completed trial 65 with data: {'y': (0.790472, 0.025)}.

[INFO 10-07 20:13:04] ax.service.ax_client: Generated new trial 66 with parameters {'x': 0.904963}.

[INFO 10-07 20:13:04] ax.service.ax_client: Completed trial 66 with data: {'y': (0.842925, 0.025)}.

[INFO 10-07 20:13:05] ax.service.ax_client: Generated new trial 67 with parameters {'x': 0.902064}.

[INFO 10-07 20:13:05] ax.service.ax_client: Completed trial 67 with data: {'y': (0.834067, 0.025)}.

[INFO 10-07 20:13:05] ax.service.ax_client: Generated new trial 68 with parameters {'x': 0.903024}.

[INFO 10-07 20:13:05] ax.service.ax_client: Completed trial 68 with data: {'y': (0.901365, 0.025)}.

[INFO 10-07 20:13:06] ax.service.ax_client: Generated new trial 69 with parameters {'x': 0.904366}.

[INFO 10-07 20:13:06] ax.service.ax_client: Completed trial 69 with data: {'y': (0.751152, 0.025)}.

[INFO 10-07 20:13:06] ax.service.ax_client: Generated new trial 70 with parameters {'x': 0.904638}.

[INFO 10-07 20:13:06] ax.service.ax_client: Completed trial 70 with data: {'y': (0.807473, 0.025)}.

[INFO 10-07 20:13:06] ax.service.ax_client: Generated new trial 71 with parameters {'x': 0.903614}.

[INFO 10-07 20:13:06] ax.service.ax_client: Completed trial 71 with data: {'y': (0.809672, 0.025)}.

[INFO 10-07 20:13:07] ax.service.ax_client: Generated new trial 72 with parameters {'x': 0.905415}.

[INFO 10-07 20:13:07] ax.service.ax_client: Completed trial 72 with data: {'y': (0.749224, 0.025)}.

[INFO 10-07 20:13:08] ax.service.ax_client: Generated new trial 73 with parameters {'x': 0.901462}.

[INFO 10-07 20:13:08] ax.service.ax_client: Completed trial 73 with data: {'y': (0.865874, 0.025)}.

[INFO 10-07 20:13:08] ax.service.ax_client: Generated new trial 74 with parameters {'x': 0.901923}.

[INFO 10-07 20:13:08] ax.service.ax_client: Completed trial 74 with data: {'y': (0.806235, 0.025)}.

[INFO 10-07 20:13:09] ax.service.ax_client: Generated new trial 75 with parameters {'x': 0.902883}.

[INFO 10-07 20:13:09] ax.service.ax_client: Completed trial 75 with data: {'y': (0.792217, 0.025)}.

[INFO 10-07 20:13:09] ax.service.ax_client: Generated new trial 76 with parameters {'x': 0.902199}.

[INFO 10-07 20:13:09] ax.service.ax_client: Completed trial 76 with data: {'y': (0.838972, 0.025)}.

[INFO 10-07 20:13:10] ax.service.ax_client: Generated new trial 77 with parameters {'x': 0.902633}.

[INFO 10-07 20:13:10] ax.service.ax_client: Completed trial 77 with data: {'y': (0.826765, 0.025)}.

[INFO 10-07 20:13:10] ax.service.ax_client: Generated new trial 78 with parameters {'x': 0.896181}.

[INFO 10-07 20:13:10] ax.service.ax_client: Completed trial 78 with data: {'y': (0.782704, 0.025)}.

[INFO 10-07 20:13:11] ax.service.ax_client: Generated new trial 79 with parameters {'x': 0.903208}.

[INFO 10-07 20:13:11] ax.service.ax_client: Completed trial 79 with data: {'y': (0.925177, 0.025)}.

[INFO 10-07 20:13:12] ax.service.ax_client: Generated new trial 80 with parameters {'x': 0.903276}.

[INFO 10-07 20:13:12] ax.service.ax_client: Completed trial 80 with data: {'y': (0.887226, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:12] ax.service.ax_client: Generated new trial 81 with parameters {'x': 0.896158}.

[INFO 10-07 20:13:12] ax.service.ax_client: Completed trial 81 with data: {'y': (0.754098, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:13] ax.service.ax_client: Generated new trial 82 with parameters {'x': 0.038212}.

[INFO 10-07 20:13:13] ax.service.ax_client: Completed trial 82 with data: {'y': (0.018841, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:13] ax.service.ax_client: Generated new trial 83 with parameters {'x': 0.797821}.

[INFO 10-07 20:13:13] ax.service.ax_client: Completed trial 83 with data: {'y': (-0.043466, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:13] ax.service.ax_client: Generated new trial 84 with parameters {'x': 0.902951}.

[INFO 10-07 20:13:13] ax.service.ax_client: Completed trial 84 with data: {'y': (0.793294, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:14] ax.service.ax_client: Generated new trial 85 with parameters {'x': 0.898303}.

[INFO 10-07 20:13:14] ax.service.ax_client: Completed trial 85 with data: {'y': (0.835135, 0.025)}.

[INFO 10-07 20:13:14] ax.service.ax_client: Generated new trial 86 with parameters {'x': 0.898164}.

[INFO 10-07 20:13:14] ax.service.ax_client: Completed trial 86 with data: {'y': (0.763833, 0.025)}.

[INFO 10-07 20:13:15] ax.service.ax_client: Generated new trial 87 with parameters {'x': 0.903124}.

[INFO 10-07 20:13:15] ax.service.ax_client: Completed trial 87 with data: {'y': (0.850393, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:15] ax.service.ax_client: Generated new trial 88 with parameters {'x': 0.904988}.

[INFO 10-07 20:13:15] ax.service.ax_client: Completed trial 88 with data: {'y': (0.697082, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:15] ax.service.ax_client: Generated new trial 89 with parameters {'x': 0.892818}.

[INFO 10-07 20:13:15] ax.service.ax_client: Completed trial 89 with data: {'y': (0.791191, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:16] ax.service.ax_client: Generated new trial 90 with parameters {'x': 0.902687}.

[INFO 10-07 20:13:16] ax.service.ax_client: Completed trial 90 with data: {'y': (0.81728, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:16] ax.service.ax_client: Generated new trial 91 with parameters {'x': 0.102977}.

[INFO 10-07 20:13:16] ax.service.ax_client: Completed trial 91 with data: {'y': (0.031802, 0.025)}.

[INFO 10-07 20:13:17] ax.service.ax_client: Generated new trial 92 with parameters {'x': 0.90282}.

[INFO 10-07 20:13:17] ax.service.ax_client: Completed trial 92 with data: {'y': (0.794052, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:17] ax.service.ax_client: Generated new trial 93 with parameters {'x': 0.891802}.

[INFO 10-07 20:13:17] ax.service.ax_client: Completed trial 93 with data: {'y': (0.744959, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:18] ax.service.ax_client: Generated new trial 94 with parameters {'x': 0.902399}.

[INFO 10-07 20:13:18] ax.service.ax_client: Completed trial 94 with data: {'y': (0.781926, 0.025)}.

/opt/conda/lib/python3.9/site-packages/botorch/optim/optimize.py:306: RuntimeWarning:

Optimization failed in `gen_candidates_scipy` with the following warning(s):
[NumericalWarning('A not p.d., added jitter of 1.0e-08 to the diagonal'), OptimizationWarning('Optimization failed within `scipy.optimize.minimize` with status 2.'), NumericalWarning('A not p.d., added jitter of 1.0e-08 to the diagonal')]
Trying again with a new set of initial conditions.

[INFO 10-07 20:13:19] ax.service.ax_client: Generated new trial 95 with parameters {'x': 0.901585}.

[INFO 10-07 20:13:19] ax.service.ax_client: Completed trial 95 with data: {'y': (0.762131, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:20] ax.service.ax_client: Generated new trial 96 with parameters {'x': 0.90377}.

[INFO 10-07 20:13:20] ax.service.ax_client: Completed trial 96 with data: {'y': (0.783592, 0.025)}.

[INFO 10-07 20:13:20] ax.service.ax_client: Generated new trial 97 with parameters {'x': 0.901044}.

[INFO 10-07 20:13:20] ax.service.ax_client: Completed trial 97 with data: {'y': (0.78154, 0.025)}.

/opt/conda/lib/python3.9/site-packages/linear_operator/utils/cholesky.py:40: NumericalWarning:

A not p.d., added jitter of 1.0e-08 to the diagonal

[INFO 10-07 20:13:21] ax.service.ax_client: Generated new trial 98 with parameters {'x': 0.903361}.

[INFO 10-07 20:13:21] ax.service.ax_client: Completed trial 98 with data: {'y': (0.842579, 0.025)}.

[INFO 10-07 20:13:22] ax.service.ax_client: Generated new trial 99 with parameters {'x': 0.901831}.

[INFO 10-07 20:13:22] ax.service.ax_client: Completed trial 99 with data: {'y': (0.877615, 0.025)}.

# Plot with error bars!
y_trials_stacked = np.maximum.accumulate(np.array(y_trials).T)
import plotly.graph_objects as go
fig = go.Figure()
px.scatter(df, x="num_samples", y="objective", error_y="stdev")
fig.add_scatter(x=df["num_samples"], 
           y=df["objective"], error_y={'array':df["stdev"]})
fig.add_scatter(x=list(range(len(y_trials_stacked))), 
           y=(y_trials_stacked).mean(axis=1),error_y={'array':y_trials_stacked.std(axis=1)})